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Abstract 

This work concerns the distance in 2-norm from a matrix polynomial to a nearest poly- 
nomial with a specified number of its eigenvalues at specified locations in the complex 
plane. Perturbations are allowed only on the constant coefficient matrix. Singular value 
optimization formulas are derived for these distances facilitating their computation. The 
singular value optimization problems, when the number of specified eigenvalues is small, 
can be solved numerically by exploiting the Lipschitzness and piece-wise analyticity of 
the singular values with respect to the parameters. 
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1 Introduction 

We study the distance from a matrix polynomial to the nearest polynomial with specified 
number of eigenvalues at specified positions in the complex plane. Formally, let P : C — > C™ x ", 
defined by 

m 

P(A):=]TA^, (1) 

3=0 

be a square matrix polynomial where Aj S C nx ™. Throughout the paper we will assume that 
rank(A m ) = n. Suppose also that a set S := {A\, . . . , A s } consisting of complex scalars and 
r e Z+ are given. This paper provides a singular value formula for the distance 

P(P,S) :=inf J ||AA|| 2 | AA e C nxn s.t. ^ mj (P(X) + AA) > r 1 (2) 
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where rrij(P) denotes the algebraic multiplicity of Xj as an eigenvalue of P(X), that is the 
multiplicity of Xj as a root of the polynomial det (P(A)). 

The formula derived is a generalization of the singular value characterization in [3] for a 
linear matrix pencil of the form L(X) = A + XA 1} which was inspired by the Malyshev's 
work [4 earlier. However, unlike [3] the derivation here fully depends on a Sylvester equation 
characterization for a matrix polynomial to have sufficiently many eigenvalues belonging to 
S. This yields a neater derivation. The distance from a matrix polynomial to the nearest 
one with a multiple eigenvalue was considered in [5], where singular value formulas yielding 
only lower and upper bounds were derived. Even though in [5] perturbations to all of the 
coefficient matrices were allowed, it is not clear how tight the derived bounds are. Here 
the derived singular value formula, when the number of prescribed eigenvalues in S is small, 
facilitates the numerical computation of the distances by means of the algorithms exploiting 
the Lipschitzness O [7] and piece- wise analyticity of singular values [2] . 

In the next section we provide a Sylvester equation and a rank characterization for the 
condition ^2j =1 TTij(P) > r. The rank characterization provides a singular value formula 
bounding the actual distance from below right away. In section [3] we establish the exact 
equality of the singular value formula with the distance by constructing an optimal pertur- 



bation. The derived singular value formula (Theorem 3.1 1 and its corollaries are summarized 



in subsection |3.3| Section |4] illustrates the validity of the results in practice on two examples 
and making connections with the e-pseudospectrum for a matrix polynomial. 

Notation: Throughout the text S r denotes the r tuples with elements from the set S, Ofc(-) 
denotes the fcth largest singular value of its matrix argument, and <X> denotes the Kronecker 
product. 

2 Rank characterization for polynomials with specified 
eigenvalues 

We first deduce a rank characterization, for a given set of complex scalars S := {Ai, . . . , A s } 
and a positive integer r, that confirms whether the scalars in S are eigenvalues of the polyno- 
mial P(X) as defined in ([I]) with algebraic multiplicities summing up to r or greater. Formally, 
if we let rrij(P) denote the algebraic multiplicity of Xj as an eigenvalue of P(X), that is the 
multiplicity of Xj as a root of det (P(A)), then we are seeking a rank characterization for the 
condition 

s 

J2mj(P)>r. 



The derivation exploits the linearization £(A) := A + XB for P(A) with 



A := 



/ 



A A 1 




I 

Am-l 



and B :— 



-I 











A, 



(3) 



and benefits from the fact that the eigenvalues of L(X) and P(X) are the same with the same 
algebraic multiplicities. Due to the assumption that rank(A m ) = n the matrix B is full rank. 
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Consequently, we could apply Theorem |2 . 1 1 concerning the multiplicities of the eigenvalues of 
matrix pencils given below to the pencil £(A). The result originally appeared in [5] Theorem 
3.3]. For the theorem we introduce the notation 



c( M ,r) = 



Ml -721 







"7rl 



"7r(r-l) 
Mr 



(4) 



where 

M = [ /ii M2 



/i r ] T e5 r and r = [ 721 731 



7r,r-l ] T GC('- 1 )/ 2 . 



We also denote the generic set of T values such that C (/z, T) has all eigenvalues with geometric 
multiplicities equal to one by G(fi). 

Theorem 2.1. Let L(X) := A + XB be a matrix pencil with A, B E c nx ™ an d suc h that 
rank(B) = n, S := {Ai, . . . , A s } be a set of complex scalars, and r G Z + . The following two 
conditions are equivalent. 

(1) ~Ylij = i'mj{A 1 B) > r where mj(A,B) is the algebraic multiplicity of Xj as an eigenvalue 
L{X)= A + XB. 

(2) There exists a /1 £ S r such that for all T € Q(p) 

dim {X E C nxr I AX + BXC(fi, T) = 0} > r. 



Theorem 2.2. Let P(X) := J2?= X3A 3 with A j € 



id swc/i rank(A m ) 



n, 

5 := {Ai, . . . , X s } be a set of complex scalars, and r € Z + . The following two conditions are 
equivalent. 

(1) nij(P) > r where rrij(P) is the algebraic multiplicity of Xj as an eigenvalue P{X). 

(2) There exists s/i£5 r such that for all T € G(p) 



dim I X e C nxr I J2 AjXC j ((j,, T) = I > r. 



3=0 



Proof. We apply Theorem 2.1 to the linearization ([3]) for -P(m)- It follows from Theorem 2.1 
that the condition Sj=i m j{P) — r ^ s me t if an d only if 



dim-j^ e 



^-Y + BAfC(/i,r) = 0} > r. 



On the other hand the partitioning X — [ Xq Xj 
reveals that the condition 



= AX + BXC(n,T) 



X m -i 

,-u -j X 3 



. X m _i ] where Xj e C n> 

-x c( M ,r) 
-x m _ 2 c( M ,r) 



POLYNOMIALS WITH SPECIFIED EIGENVALUES 



4 



could be expressed as X,j = Xj-\C(ji,T) for j = 1, 



1 and 



m— 1 



3=0 

By eliminating Xj for j = 0, . . . , m— 1 in the last equation using Xj = XoC(/i, r) J we obtain 

m 

Y,AjX Q C{ii,Ty = 0. 

3=0 

To summarize Xq is a solution of J2T=o AjXC(ji, Ty = if and only if 



x£ (XoC^v)) 1 ... (x Q c™-V,r)) J 

is a solution of AY + BXC(fi, T) = and the result follows. 

Finally we express the last Sylvester characterization as a rank condition. 

Corollary 2.3. Let P(X) := J2T=o X3A 3 with A i e C " X " and such that rank(A r , 
S :— {Ai, . . . , X s } be a set of complex scalars, and r € Z + . The following two conditions are 
equivalent. 

(1) ^2j = i riij(P) > r where irij(P) is the algebraic multiplicity of Xj as an eigenvalue P(X). 

(2) There exists a /i € S r such that for all T £ G{fJ-) 



□ 



n. 



rank ( (C j (/i, T)) T <g> A - ] < 



Proof. The result follows from Theorem |2.2| by applying the identity 

vcc(AXB) = (B T <g) A) vec(X) 
to the Sylvester equation Y^j=o AjXC^fi, T) = □ 

For instance we deduce the following when S — {/i} and r — 2 from the corollary above; 
the matrix polynomial P(X) has /i as a multiple eigenvalue if and only if 



rank j 



,u 
7 M 



rank 



p(aO o 

7 p'(/i) p(/i) 



< 2n- 2 



for all 7^0. 
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3 Derivation of the Singular Value Formula 

For each /i g S r let us define the quantity 

P(P,H) :=inf J ||AA|| 2 | rank ( ^ L)) T ® A,- + I <8 (A + AA) ] < 



for any F G Q{^)- Then, from Corollary 2.3 the distance to the nearest polynomial with 
specified eigenvalues could be expressed as 

P(P,S) := inf /3(P,/x), 

l-<.£S r 

so it suffices to derive a singular value formula for f3(P, /i). 
We immediately deduce the lower bound 

P(P,fJ.) > K(P,fl) := SUp Vn-r-r+l [^(CnpX)) 7 ®A ]+ I®A ] , (5) 



since for any matrix B the distance in 2-norm to the nearest matrix of rank r is given by 
<7,. + i(£>). We could not immediately deduce the upper bound because the allowable pertur- 
bations have structure, specifically they are of the form I <g) AA. 

To establish the validity of the reverse inequality (3(P, /i) < k(P, /i) it is sufficient to 
construct a perturbation AA* such that 

(i) ||Ai4.|| 2 = K(P,/*), and 

(ii) rank (Y% =1 (C* J (/i, T)) T (g> A 3 + I (g> (A + AA,)) < n ■ r - r for some Y e 

It can be shown that the singular value function in ([5| approaches zero as any of the com- 
ponents of T goes to oo. (By using Cramer's rule it is possible to deduce that the n largest 
singular values of the inverse of the matrix in ([5| blow up as one of the components of T goes 
to oo.) Since the singular value function depends on T continuously, the supremum in ^ 
must be attained. Let be such a point point where the supremum in ([5| is attained, that 
is 

k(P,(j.) =ff„. r _ r+1 (C^n^^f ^Aj A j . (6) 

Let U, V G C lr be a consistent pair of unit left and right singular vectors associated with this 
singular value, in particular U and V satisfy 

m \ 

^(C j (m,F s ,)) T ® A 3 +J® aA V = k(P,h)U (7) 



and 



U* (^(C^F*)) 7 '®Aj+I®A ] =K(P,fx)V*. (8) 
a =1 
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Throughout the rest of this section we prove that 

AA* := -k(P,h)UV + (9) 

satisfies both of the properties (i) and (ii) above, where U, V e C" xr are such that U — vec(U) 
and V = vec(V) under the following mild assumptions. 

1. (Multiplicity Assumption) The multiplicity of the singular value 

£T n . r - r+ i I 2j(c j (/i,r»)) ®Aj + i®A 

is one. 

2. (Linear Independence Assumption) rank(F) = r 
3.1 Norm of AA* 

We aim to show that || A^* || 2 = n(P,fi). For this purpose, it is sufficient to establish the 
validity of U*U = V*V, since this property implies 

\\UV+\\ 2 = max J(V+)*U*UV+w= max J {V+f V*VV+w = \\VV + \\ 2 = 1 
wec n , |id|| 2 =i v ii>ec n , |tu|| 2 =i v 

where the last equality is due to the fact that VV + is an orthogonal projector. 

Throughout the rest of this subsection we prove the property U*U — V*V under the 
multiplicity assumption. Let 

m 

a(T) :=<r„. r _ r+1 (F(r)), where F(T) := ^ (C j (fx, T)f ® A,- + I ® A r 

j=l 

Then the partial derivatives of F(T) with respect to the real and the imaginary parts of the 
components 7^ of V are 

/ -1 \ T 



m j — 1 

= -EE i "^ VeieZC*- 1 -'^, T)) T ® Aj, 
j=i e=o 

= - l E E iWC'- 1 "^, T)) T ® A,-, 

j=i £=0 
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where ej (e&) denotes the ith (the fcth) column of the r x r unit matrix, and 1 < i < k < r. 
Let 

m j'-l 

G : = EE^r.lE/'AjV^r,). (to) 

3=1 £=0 

From the assumption that the singular value cr(r*) is simple it follows that the function 
r i— > cr(r) is analytic at r*, and 

^ (T.) 



(/ m j-l 
vec(£/)*vec ^ ^ A/ V C e (n, T^eJC 3 - 1 ^^, r,) 
\i=i £=o 

(m j— 1 
^ S£ ^ 7 rOeieJc^'- 1 -'^, r,) 
3=1 i=0 

= -U ( e^Ge;) for 1 < i < k < r. 

The latter equation follows from the trace identity tr(XY) = tr(YX). Analogously we have 

= ^—(r*) = ^{-lelGei) = ^(ejGe,) for 1 < k < i < r. 

Thus, G is upper triangular. Let 

m J — l 

M = -c/*Aoy + 5E5Zc , ^(/x,r*)c/*A J yc^(M,r i( ). (11) 
j=i «=i 

Then, it is easily verified that 

m 
3=0 

= M + a(T t )U*U, 
where the last equality follows by writing ^ in matrix form. Also, 

c(/z,r,)G = m+ ^c J o*,r,)tf%-j v 

= M + a(r*)F*F, 
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where the last equality follows from |8]). Thus, 

a(T,)(U*U - V*V) = GCQi, r,) - C(fi, T*)G. (12) 

Since G and C(fj,,T^) are both upper triangular, the right hand side of this equation is 
strictly upper triangular. The left hand side is Hermitian. Hence, both sides vanish. Thus, 
U*U = V*V. 

3.2 Sylvester Equation for Perturbed Matrix Polynomial 

In this subsection we show that 

dim|xeC" xr | jr^A j XC j fa ) r*) + {Ao + AA*)X = o\ >r (13) 

under the assumption that V is full rank, where is as defined in Our starting point is 
the singular value equation Q, which could be rewritten as a matrix equation of the form 

m 

^AjV&far.) = k(p,h)u 

0=0 

Assuming V is full rank we have V + V = I. Consequently, 

m m 

J2 A jVC j (n,T*) = n{P,p)UV + V =^> J2 A 3 VC3 (^*) + {A + AA*)V = 0. 

Moreover, consider the subspace of matrices 

D:={DeC rxr | G(n,T*)D-DC(iJ,,r*)=0} 

commuting with C(/i,r*), which is of dimension at least r (due to Theorem 3.1 in [3]). For 
all D E T) , we have 

m m 

= AjVC j (n,r*)D + (A + AA t )VD = A j(VD)C j {(i, T,) + (A + AA,)(VD) 
meaning each matrix in the set {VD \ D e V} is a solution of the Sylvester equation 

m 

J2 A J x C j (^ r *) + i A o + & A *)X = 0. 

3=1 



Therefore, we conclude with (131 assuming V is full rank 
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3.3 Main Result and Corollaries 

Let us first suppose fi consists of distinct scalars. Then all eigenvalues of C(/j,, T) have algebraic 
and geometric multiplicities equal to one for all T, implying G(fJ-) = C r(> ~ 1 )/ 2 . Consequently, 
we have r* £ G(^), where r* is as defined in It follows from Sections 3.1 and 3.2 that 
/3(P, f-t) = k(P, /j) under multiplicity and linear independence assumptions at the optimal IV 
When there are repeated scalars in /i, then there are fi comprised of distinct scalars and 
arbitrarily close to /i, where the equality /3(P, /i) = k(P, p,) is satisfied under multiplicity 
and linear independence assumptions. Then, the equality /3(P, /j) = k(P, /i) follows from 
the continuity of both /3(-) and k(-) with respect to /z (again under multiplicity and linear 
independence assumptions). We arrive at the following main result of this paper. 

Theorem 3.1 (Distance to Polynomials with Specified Eigenvalues). Let P(\) := 
y^T—Q A J Aj with Aj G C nx ™ and such that rank(A m ) = n, S := {Ai,...,A s } be a set of 
complex scalars, and r € Z + . 

(i) Then the singular value characterization 



/3(P,S) = inf sup ow-r+i 

reel"-- 1 )/ 2 



(C J (M,r)) <E)Aj+I<E>A 



(14) 



holds, for the distance /3(P, S) as defined in Q), provided that the multiplicity and linear 
independence assumptions hold at the optimal fi G S r and T G C r ( r - 1 )/ 2 . 

(ii) The minimal AA* in 2-norm such that Y)j—i m j (-P(A) + AA*) > r is given by but 
with n replaced by which is the [i value where the outer infimum in (14) is anained. 



Specifically, when S — {fi} and r = 2, we obtain the following characterization for the 
distance to the nearest polynomials with fi as a multiple eigenvalue. Even though the details 
are long and technical, it can indeed be shown that even if the multiplicity and linear inde- 
pendence assumptions are violated, the singular value formula remains valid in this special 
case. 

Corollary 3.2 (Distance to Polynomials with Multiple Eigenvalues). Let P(X) := 
^2T=o ^ A? with Aj G C" x ™ and such that rank(A m ) = n, and fi G C. Then 



inf{||AA|| 2 I P(X) 



AA has \x as a multiple eigenvalue} = sup 02ri-i 

7 eM 



P( M ) 
jP'(fi) P(li) 



For the above result concerning the nearest polynomials with a multiple eigenvalue, it is 
again possible to construct the minimal perturbation using the formula in ([9]). Also note that 
the maximization is over the real numbers for this special case, since the singular values of 



7 P» P(ll) 



and 



P{li) 
| 7 |P'( M ) P(m) 



are the same for all 7 G C. Corollary |3.2| could easily be generalized for the nearest polyno- 
mials with fi as a multiple eigenvalue of specified algebraic multiplicity. Again the optimal 
perturbations are given by the formula in (JoJ) . 
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Corollary 3.3 (Distance to Polynomials with Eigenvalues of Specified Multiplic- 
ity). Let P(X) := Y^jLo^Aj with Aj € C" x ™ an d such that rank(^4 m ) = n, fi € C and 
r G Z + . Then 

inf { 1 1 A. j4 1 1 2 | P(A) + AA has /i as an eigenvalue of algebraic multiplicity > r} = 



sup 

reCr(r _i) /2 





/ 


/ - 


r+l 


m 

E 












V 


I- 



Mi o 
721 M 











® Aj 



\ 



I®A 



J 



I 



7rl 7r(r-l) j" 

'provided that the multiplicity and linear independence assumptions hold at the optimal T. 

Finally in control theory it is of interest to place the eigenvalues of a dynamical system at 
desired locations in the complex plane. For instance stability is an essential condition. The 
main result, with n = r and S = C_ denoting the open left-half of the complex plane, provides 
us with a characterization of the nearest stable systems given an unstable higher-order linear 
system with some of the eigenvalues on the right-half of the complex plane. 

Corollary 3.4 (Distance to Stability for Matrix Polynomials). LetP(\) := Y^JLo ^ Aj 
with Aj £ C" x " and such that rank(A m ) = n. Then 

inf { 1 1 A.yl| 1 2 | P(X) + AA has all eigenvalues with negative real parts} = 



inf 



sup a n 2_ n+1 



E 

i=i 



V 



Mi 

721 M2 

7nl 









7n(n-l) Mn 



I ®A 



J 



J 



provided that the multiplicity and linear independence assumptions hold at the optimal T and 
fi. 



4 Numerical Examples 

We illustrate our main result Theorem |3.1| and Corollary |3.2| on two examples that can be 
visualized by means of the e-pseudospectrum of the polynomial P(X). The e-pseudospectrum 
that is related to our results consists of the eigenvalues of all polynomials within an e neighbor- 
hood with respect to the 2-norm and when only the constant coefficient matrix is perturbed, 
that is 

A e (P) := |J A(P(X) + AA) 

\\AA\\ 2 <e 

= {z e C | a n (P{z)) < e}. 



where A(P(A)) denotes the spectrum of the polynomial P(A). 

The derivation in the previous section establishes that any stationary point of the inner 
maximization problem in ( 14 ) is a global maximizer as long as the multiplicity and linear 
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independence assumptions hold. Consequently, we solve the inner problems using quasi- 
Newton methods numerically. For the numerical solutions of the outer minimization problems 
we depend on the technique recently described in [2] , which exploits the piece- wise analyticity 
of a singular value function of a matrix function depending on a parameter analytically. 

Both of the numerical experiments below is performed on a 5 x 5 matrix polynomial of 
degree two, whose entries are selected from a normal distribution with zero mean and unit 
variance. 



4.1 Polynomials with Two Prescribed Eigenvalues 

Suppose that S = {X±, A2} and r = 2 so that two eigenvalues are prescribed, and the distance 
to a nearest polynomial for which at least two of the eigenvalues belong to S is sought. Then 



the singular value formula ( 14 ) takes the form 



(3(P,S) = inf supo^n-i 





7- PA(fJ>i,H2) P(fJa) 



(15) 



where 



P&{Vl,H2) 



P( Pl )-P(p 2 ) 
Ml— M2 



P'(Hl) 



if Mi 7^ M2, 
if Mi = M2- 



Here, we calculate this distance for the quadratic matrix polynomial mentioned at the 
beginning of this section with random entries, and for the prescribed eigenvalues S = {—0.3 + 
O.li,— 0.65}. The boundaries of the e-pseudospectra of the quadratic matrix polynomial are 
plotted in Figure [l] together with the prescribed eigenvalues marked by asterisks. In particular 
the outer curves correspond to the boundary of the e-pseudospectrum for e = 0.5879, which 



is the computed distance f3(P,S) by means of the characterization (15). On one of these 
outer curves one of the prescribed eigenvalues Ai = —0.3 + O.lz lies. However, we remark 
that one of the prescribed eigenvalues does not always have to lie on the boundary of the e- 
pseudospectrum for e = /3(P, <S); in general both of the prescribed eigenvalues may lie strictly 
inside the pseudospectrum. 



4.2 Nearest Polynomials with Multiple Eigenvalues 



By Corollary |3.2| the distance to a nearest matrix polynomial with a multiple eigenvalue is 
given by 

P(p) 
7 P'(//) P(/x) 



inf 



SUp <7 2 r, 

7GR 



For a matrix polynomial of size n x n and degree m the e-pseudospectrum for small e is 
comprised of nm disjoint components, one around each eigenvalue. The smallest e such that 
two components of the e-pseudospectrum coalesce is equal to this distance. This is not an 
obvious fact; indeed for matrices this has been proven by Alam and Bora pQ not long time ago. 
The extension of the proof due to Alam and Bora for matrix polynomials is straightforward. 

For the random quadratic matrix polynomial we compute this distance as 0.3211. Two 
components of the e-pseudospectrum for e = 0.3211 coalesce as expected in theory. This 
is illustrated in Figure [2j specifically the inner-most curves represent the boundary of this 
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Figure 1: The pseudospectra of the quadratic random matrix polynomial. The asterisks 
are the prescribed eigenvalues. The black crosses represent the eigenvalues of the matrix 
polynomial 
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Figure 2: The e-pseudospectra of the quadratic random matrix polynomial for various e are 
illustrated. The inner most curve corresponds to the boundary of the e-pseudospectrum for e 
equal to the distance to a nearest matrix with a multiple eigenvalue. The red asterisk is the 
multiple eigenvalue of a nearest matrix polynomial. 

e-pseudospectrum. The point of coalescence of the components z — 0.0490, marked by an 
asterisk, is the multiple eigenvalue of a nearest polynomial. 

5 Concluding Remarks 

We derived a singular value optimization characterization for the distance from a matrix 
polynomial to a nearest one with a specified number of eigenvalues belonging to a specified 
set. We restricted ourselves to square matrix polynomials. Extensions to the rectangular 
matrix polynomials is straightforward as long as the leading coefficient matrix is full rank. 

There are two important open problems that are left untouched by this paper. First, it 
is more desirable to allow perturbations to all coefficient matrices from an application point 
of view. In this case an exact singular value formula is not known at the moment. Secondly, 
the results are proven under mild multiplicity and linear independence assumptions. Our 
experience with special instances indicates that the singular value formula remains valid, 
even when these assumptions are not met. We conjecture that neither of the assumptions is 
needed for the validity of the singular value characterization. 



POLYNOMIALS WITH SPECIFIED EIGENVALUES 



14 



References 

[1] R. Alam and S. Bora. On sensitivity of eigenvalues and eigendecompositions of matrices. 
Linear Algebra Appl., 396:273-301, 2005. 

[2] M. Kilic, E. Mengi, and E.A. Yildirim. Numerical optimization of eigenvalues of hermitian 
matrix functions. SIAM J. Matrix Anal. Appl., 2012. submitted. 

[3] D. Kressner, E. Mengi, I. Nakic, and N. Truhar. Generalized eigenvalue problems with 
specified eigenvalues. IMA J. Numer. Anal, 2011. accepted subject to minor revision. 

[4] A. N. Malyshev. A formula for the 2-norm distance from a matrix to the set of matrices 
with multiple eigenvalues. Numer. Math., 83:443-454, 1999. 

[5] N. Papathanasiou and P. Psarrakos. The distance from a matrix polynomial to matrix 
polynomials with a prescribed multiple eigenvalue. Linear Algebra Appl, 429:1453-1477, 
2008. 

[6] S. A. Piyavskii. An algorithm for finding the absolute extremum of a function. USSR 
Comput. Math, and Math. Phys., 12:57-67, 1972. 

[7] B. Shubert. A sequential method seeking the global maximum of a function. SIAM J. 
Numer. Anal, 9:379-388, 1972. 



